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(54) ADAPTIVE DISPLAY SPEED AUTOMATIC ADJUSTER OF MOVING VIDEO 
AND ITS MANUFACTURE 

(5 7) Abstract* 

PROBLEM TO BE SOLVED: To adaptively change reproduction speed in variable-speed 
reproduction period to match visual characteristics of a human by dynamic 
characteristics of the video by detecting ratio of change of a video and reproducing the 



r 



video at higher speed or lower speed than the high or low reproduction speed having 
predetermined constant speed according to the change. 

SOLUTION- A cut of the moving video is detected by reading a digital moving video life 
101 to be displayed and the number of frames between two cuts is extracted by a cut 
detecting module 102a. A differential video between the frames of the video is calculated 
and pieces of moving video data for variable speed and the constant speed including 
detection information of the modules 102a, 102b are stored in first and second storage 
modules 103 and 104 by a differential video module 102b. Acceleration/deceleration of 
display speed during the variable-speed reproduction period is controlled by judging a 
degree of the change of the video from the number of frames between the cuts and the 
differential video by a display module 105. Thus, the degree of variable speed is 
automatically adjusted in consideration of sensation characteristics of the human. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

CLAIMS 
[Claim(s)] 

[Claim 1] A moving picture detection means to read the digital moving picture file 
to display, to detect the cut of a moving picture, and to search for the difference 
image between the two detected frames which the number of the frames 
between two cuts was extracted, and the moving picture followed, A storage 
means to memorize new moving picture data including the number and 
difference image information on a frame between said two cuts with the original 
moving picture file, Accommodative display rate automatic regulation equipment 
of the moving picture characterized by including a display means to display a 



moving picture at a rate quicker than the display rate set up to the period within a 
gear change display period, using said moving picture data or the original 
moving picture. 

[Claim 2] The number of the frames between said two cuts is accommodative 
display rate automatic regulation equipment of the moving picture according to 
claim 1 characterized by being the distance information forjudging conversion of 
a scene. 

[Claim 3] Said difference image information is accommodative display rate 
automatic regulation equipment of the moving picture according to claim 1 
characterized by being the rate of change of a motion of an image. 
[Claim 4] Said moving picture detection means is accommodative display rate 
automatic regulation equipment of the moving picture according to claim 1 
characterized by the thing which the moving picture followed, and for which the 
rate of change of a moving picture is detected from the number of the frames 
between two cuts. 

[Claim 5] Said display means is accommodative display rate automatic 
regulation equipment of the moving picture according to claim 1 characterized by 
making the number of the frames flown on the basis of the number of the frames 



detected with said moving picture detection means change, and performing a 
high-speed display. 

[Claim 6] the number of said frames to fly - Skip_k=lnteger - the 
accommodative display rate automatic regulation equipment (it is here) of the 
moving picture according to claim 5 characterized by being adjusted by the 
formula of [Dist(k)/(aDist (k) +b)] The number of the frames which applied ip_k 
off to the frame from the k-th cut to the k+1st cuts, The predetermined constant 
for deciding extent of the according [ the number of the total frames between two 
cuts and a ] to magnitude of Dist (k) automatic rate accommodation when Dist 
(k) continues, Integer is a predetermined constant for defining the minimum time 
amount required for b displaying during a cut and a cut, and integer-ization of the 
computed value. 

[Claim 7] Accommodative display rate automatic regulation equipment of the 
moving picture according to claim 6 characterized by the number (Skip_k) of the 
frames which will be flown if said Dist (k) is large increasing, and being displayed 
relative more quickly within a high-speed period, and for the number (Skip_k) of 
the frames to fly decreasing and being relatively displayed more slowly within a 
high-speed period if Dist (k) is small. 



[Claim 8] The period during all cuts and cuts is accommodative display rate 
automatic regulation equipment of the moving picture according to claim 6 
characterized by displaying b fixed hours altogether irrespective of the die length 
when said a is 0, and displaying the period during all cuts and cuts 1/a time as 
quickly as the usual rate when said b is 0. 

[Claim 9] Said moving picture detection means is accommodative display rate 
automatic regulation equipment of the moving picture according to claim 1 
characterized by detecting the fate of change of a moving picture from the 
difference image between the frames which the moving picture adjoined. 
[Claim 10] Said display means is accommodative display rate automatic 
regulation equipment of the moving picture according to claim 1 characterized by 
making the period of a frame change on the basis of the magnitude of the 
detected difference image, and performing low-speed playback. 
[Claim 1 1] The period of said frame changed is T'(n) =Torig(n) *mDiff(n) *beta. if 
it is T'(n) <Tmin - T - the accommodative display rate automatic regulation 
equipment (here) of the moving picture according to claim 4 characterized by 
being adjusted by the formula of (n) =Tmin T (n) is the period of the frame with 
which the n-th frame was changed, and Torig is the period of the original frame. 



the case of (NTSC - 1 / 30-second), and mDiff (n) - the magnitude of a 
difference image with the contiguity frame in the n-th frame, and Tmih - an 
equipment - it is the period of the minimum anaclitic frame and beta is a rate 
accommodation multiplier which determines extent of automatic rate 
accommodation. 

[Claim 12] If the magnitude (mDiff (n)) of said difference image is large, the 
period (T (n)) of a frame becomes large and are relatively displayed more slowly 
within a low-speed period, and if the magnitude (mDiff (n)) of a difference image 
is small Accommodative display rate automatic regulation equipment of the 
moving picture according to claim 1 1 characterized by for the period (T (n)) of a 
frame becoming small and being displayed relative more quickly within a 
low-speed period. 

[Claim 13] The phase of reading a moving picture file from the storage means of 
digital data, The phase of extracting the difference image between two frames 
which detected the cut and continued and which the number of the frames 
between two cuts was extracted, and said moving picture followed from said 
moving picture file, The phase of memorizing the number and difference image 
information on a frame between said cuts with the original moving picture file, 



The number of the frames flown on the basis of the number of the frames 
between said memorized cuts is adjusted. The accommodative display rate 
automatic regulation approach of the moving picture characterized by consisting 
of the phase of performing a high-speed display, and the phase of adjusting the 
period of a frame on the basis of said memorized magnitude of a difference 
image, and performing a low-speed display. 

[Claim 14] The accommodative display rate automatic regulation approach of the 
moving picture according to claim 13 characterized by for the number of the 
frames which will be flown if the distance between the continuous cuts is large in 
said high-speed display phase increasing, being displayed relative more quickly 
within a high-speed period, and for the number of the frames which will be flown 
if the distance between the continuous cuts is small decreasing, and being 
relatively displayed more slowly within a high-speed period. 
[Claim 15] The accommodative display rate automatic regulation approach of the 
moving picture according to claim 13 characterized by the period of a frame 
becoming large and being relatively displayed more slowly within a low-speed 
period if two inter-frame difference images are large, and for the period of a 
frame becoming small and being displayed relative more quickly within a 



low-speed period in said low-speed display phase if two inter-frame difference 
images are small. 

[Claim 16] The accommodative display rate automatic regulation approach of the 
moving picture according to claim 13 characterized by performing alternatively a 
gear change display mode or automatic rate accommodation mode within the 
gear change period of a moving picture file in said display phase. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the accommodative display rate 
automatic regulation equipment and the approach which enabled 
accommodative gear change to which it is made adapted for change of a motion 
of the image in the playback period which changed gears, and a high speed or 
low-speed reproduction speed is especially changed within the gear change 
period of a high-speed display (high-speed playback) or a low-speed display 
(low-speed playback) about the display approach of a moving picture. 
[0002] 

[Description of the Prior Art] Since the reproduction speed is being fixed to the 
fixed rate defined beforehand, when performing a high speed or low-speed 
playback, a viewer's visual property cannot be satisfied in the gear change 
playback mode of the conventional moving picture. For example, at the time of 
high-speed playback, in the intense scene of change of the screen by time 



amount, a user cannot recognize the scene easily and, on the other hand, the 
sensibility currently fast forwarded does not carry out by the late scene of 
change of a screen. Moreover, at the time of low-speed playback, in the intense 
scene of change of the screen by time amount, since it may pass quickly and a 
screen converts further slowly in the late scene of change of a screen conversely 
even if a user wants to recognize the scene slowly, it tends to become tedious. 
[0003] Usually, high-speed playback is performed for the purpose of high-speed 
retrieval, and low-speed playback is performed for the purpose of observing a 
specific motion to a precision more, therefore - if it actually thinks from a user's 
vision and sensuous viewpoint - a high speed and a low speed - the scene 
conversion slowly made some is expected in intense Tokoro of change of a 
motion, and, in any case, conversion of a quick scene is somewhat expected by 
late Tokoro of change of a motion. However, a demand of such a user cannot be 
answered in the conventional fixed gear change playback. 
[0004] That is, if the reproduction speed of a moving picture is reproduced in the 
state of gear change of a high speed or a low speed in the case of conventional 
image equipment, since it will reproduce at the fixed fixed high speed or fixed 
low speed, the following problems arise. When conversion of a scene is a late 



image at the time of high-speed playback, since tedious scene conversion 
advances even if it reproduces at a quick rate, the purpose (dynamic viewing 
and listening between scenes) of high-speed playback fades. On the contrary, 
when scene conversion is a quick image, scene conversion is too quick and 
retrieval comes to be hard. Since scene conversion is a high speed at the time of 
low-speed playback even if it reproduces at a late rate in the case of the quick 
image of a motion, the purpose (precise viewing and listening between scenes) 
of low-speed playback is spoiled. On the contrary, in the case of the image which 
does not almost have a motion like a halt image, the tedious advance must be 
watched over long duration. 
[0005] 

[Problem(s) to be Solved by the Invention] Made in order that this invention 
might solve the trouble generated at the time of gear change playback of the 
conventional moving picture, the purpose is enabling it to change change ****** 
playback extent of the image within a gear change playback period. 
[0006] 

[Means for Solving the Problem] this invention - the rate of change of an image 
- detecting - the change - responding - beforehand - a law - it is 



characterized by reproducing at a rate quicker than the high speed or low-speed 
reproduction speed of ******** constant speed, or reproducing at a late rate. Thus, 
this invention changes the reproduction speed within the gear change playback 
period accommodative according to human being's vision property with the 
dynamic trait of an image. 
[0007] 

[Embodiment of the Invention] Hereafter, **** explanation is given with reference 
to the drawing of attachment of the accommodative display rate automatic 
regulation equipment of the moving picture by this invention, and the desirable 
operation gestalt of the approach. Drawing 1 is a block diagram by the 
accommodative rate automatic regulation equipment of the moving picture of 
this operation gestalt, and drawing 2 is a flow chart by the accommodative rate 
automatic regulation approach of a moving picture. As shown in drawing 1 , the 
accommodative rate automatic regulation equipment of the moving picture of 
this operation gestalt Cut detection module 102a which detects extent of change 
of an image in order to control the reproduction speed in a gear change playback 
period by the digital moving picture file 101, extracts the cut in an image, and 
calculates the, number of the frames between cuts, The information detection 



module 102 for rate accommodation which consists of difference image 
detection module 102b memorized in quest of the inter-frame difference image 
of an image, The 2nd storage module 104 which memorizes the 1st storage 
module 103 and the moving picture data for constant speeds which memorize 
the moving picture data for gear change including the detection information on 
cut detection module 102a and difference image detection module 102b, The 
display module 105 which judges change extent of a frame number and an 
inter-frame difference image to the image during a cut, and carries out ** / 
decrease control of the display rate in a gear change playback period is included. 
[0008] In cut detection module 102a, detection of the cut for the judgment of 
scene conversion, the indexing of the detected cut, and the distance (number of 
frames) information between cuts are extracted and memorized. Extent of 
change which detects the following inter-frame difference image and moves by 
difference image detection module 102b for every frame (motion of an image) is 
memorized. In a display module 105, it has an algorithm about the distance 
between the extracted cuts (the number of frames) to high-speed playback, and 
an algorithm about the rate of change and rate of a motion to low-speed 
playback which were detected. 



[0009] Drawing 2 shows the flow chart of the accommodative rate automatic 
regulation approach of the moving picture of above-mentioned this invention, 
and explains concrete relation of operation with reference to drawing 1 . The 
accommodative rate automatic regulation equipment of a moving picture reads 
the predetermined moving picture file 101 (201). In the phase of the information 
detection module 102 for rate accommodation, each activation of cut detection 
module 102a and difference image detection module 102b is performed to 
coincidence. After cut detection and difference image detection are performed to 
coincidence, the information detected from each module is memorized with new 
moving picture data and a moving picture file. This corresponds to the 1st 
storage module 103 and the 2nd storage module 104 in drawing 1 . 
[0010] First, the cut detection phase 202 is performed the following process. A 
cut is. an element which classifies between the scene of a moving picture, and 
scenes. Therefore, the cut defined as the boundary of the scene which changes 
a screen rapidly is detected, the number of the indexing of the detected cut, and 
cuts, the next cuts following the cut and the frames of a between (distance 
information) is calculated, and the information is memorized with a moving 
picture file so that a location, a background, etc. in an image may change (204). 



[0011] As mentioned above, the method (algorithm) of detecting a cut and 
asking for the number of the frames during a cut can use the approach of 
common knowledge of arbitration. A color histogram is used with this operation 
gestalt. This is regarding this scene as the same cut, when the difference of the 
color histogram between two continuous frames is beyond a critical value. Next, 
the number of the detected frames which enter between two cuts shows the 
distance between cuts, i.e., the distance information between two continuous 
cuts, (the number of frames). Thus, origin [ it consisted of continuous frames ] 
memorizes the extracted cut information (location of a cut), and the distance 
information during a cut (the number of frames) to the 2nd storage module 104 
with the original moving picture file 101. The 2nd storage module 104 is 
realizable by distributing a memory area appropriately using the same memory 
as the 1st storage module. 

[0012] Next, a difference image detection phase (203) is performed by the 
following process. The magnitude of a difference image is the difference of the 
motion between two frames which adjoined, and when a big motion exists 
between two frames which are forward and backward in time or the screen itself 
changes, it becomes large. Therefore, the magnitude of a difference image 



subtracts the pixel value corresponding to the n-th frame and the n+1st frames, 
respectively, and should just calculate it. Thus, the information on the magnitude 
of the difference image searched for is memorized to the 2nd storage module 
104 with the moving picture file 101 of the origin which consisted of continuous 
frames (204). 

[0013] A storage phase (204) memorizes the result of cut detection or difference 
image detection with the original moving picture file. Thus, gear change control 
to which the image was fitted using the cut detection information and difference 
image detection information which were memorized at the time of activation of 
the high-speed playback or low-speed playback by demand of a user is 
performed. The process is performed in the procedure of a phase (205) thru/or a 
phase (210), and is performed by the display module 105 of drawing 1 . 
[0014] When the number of the frames flown when a user desires high-speed 
playback (the number of the frames made to skip) is adjusted, the rate within a 
high-speed period is adjusted appropriately and it desires low-speed playback, 
the period of a frame is changed and the rate within a low-speed period is 
adjusted appropriately. 

[0015] First, the case where high-speed playback is demanded by the user is 



explained. When it desires high-speed playback by this invention, if the rate of 
change of a screen is large, the rate of change which a user senses will be 
uniformly maintained in comparison by displaying slowly in high-speed playback 
notes, and displaying from original high-speed reproduction speed, in them more 
quickly [ when reverse ] than original high-speed reproduction speed. Thus, 
irrespective of the gear change period of a moving picture, a user can adjust 
reproduction speed with almost same recognition extent over the whole term of 
high-speed gear change, and can search fitting high-speed reproduction speed 
to an image within the period, and carrying out ** / gear change control for a 
moving picture minute. This has solved the constraint by the number of the 
frames to fly having been fixed that it went on at the high speed and the section 
when many important frames are contained was not able to be searched to a 
precision, either, in high-speed playback of the conventional moving picture. In 
the former, the original frame was flown and displayed at fixed spacing (for 
example, five frames) at the time of a high-speed display. On these 
specifications, conventional high-speed playback and low-speed playback are 
called high-speed playback of ordinary earliness, and low-speed playback of 
ordinary earliness. The user enables it to choose playback by accommodative 



**/gear change which was described above, high-speed playback of ordinary 
earliness, and low-speed playback with this operation gestalt. 
[0016] As described above, it judges whether it is high-speed playback for 
accommodative ** / gear change control within a high-speed playback period 
(205). As for a display module 105, in high-speed playback, therefore, 
accommodative ** / gear change is performed for performing the following 
display control in the high-speed display phase 206. That is, the number of the 
frames flown with an algorithm like a degree type is adjusted. 
Skip_k=integer [Dist(k)/(aDist (k) +b)] — Formula 1 thenSkip_k=1 — Formula 
2 the number of the frames which applied SkipJ< off to the frame from the k-th 
cut to the K+1st cuts, and Dist (k) here The predetermined constant for deciding 
extent of continuous according [ the distance information between two cuts (the 
number of the total frames) and a ] to magnitude of Dist (k) automatic rate 
accommodation, The predetermined constant for defining the minimum time 
amount required for b displaying between one a cut and a cut and integer show 
integer-ization of the computed value. 

[0017] When between a cut and cuts is shorter than the short ** past ** display 
time amount b, it displays at the rate of usual, and is made not to abolish the 



information on the period by the formula 2. Since it is decided beforehand, when 
the number of the frames to fly is adjusted, if the distance during a cut is large 
(i.e., if a Dist (k) value and the value of a and b have large Disk (k)), number 
Skip_k of the frame to fly increases and they are displayed relative more quickly 
within a high-speed period, several [ of the frame which will be flown if Disk (k) is 
small (if the distance between cuts is small) ] - Skip_k decreases and it is 
relatively displayed more slowly within a high-speed period. 
[0018] Moreover, by specifying appropriately the constant a which adjusts the 
constant b and the relative rate for adjusting the whole rate, number Skip_k of 
the frame to fly is considered with the distance between cuts, and can change 
automatic regulation extent of a rate. Regardless of that die length, b hours of 
regularity are displayed altogether at the period between all cuts in case a is 0 at 
this time. And only 1/a time, the period between all cuts in case b is 0 is quickly 
displayed by ordinary earliness, and serves as a general high-speed display 
method from it. 

[0019] Next, the case where low-speed playback is demanded by the user is 
explained. When it desires low-speed playback with this operation gestalt, if a 
motion of a moving picture is large, the rate of change which a user senses will 



be uniformly maintained in comparison by displaying slowly and displaying from 
the rate of ordinary low-speed playback, within a low-speed playback period, 
more quickly than the rate of low-speed playback ordinary when reverse. Thus, 
irrespective of the gear change period of a moving picture, a user can adjust 
reproduction speed with almost same recognition extent over the whole term of 
low-speed gear change, and can search carrying out ** / gear change control of 
the low-speed reproduction speed accommodative within the period for a moving 
picture to a precision. Since the period of a frame is being fixed by low-speed 
playback of the conventional moving picture, many important frames advance 
also in the period which is not included at a low speed, and, as for this, constraint 
that tedious retrieval is performed is canceled. The period of said frame means 
the period at the time of the time amount by which one frame is displayed by the 
screen, i.e., the normal playback expressed as "Torig", here. In the former, it 
displays slowly by specifying the period of a frame more greatly than the period 
of the frame at the time of normal playback at the time of a low-speed display. 
The user enabled it to perform alternatively low-speed playback of ordinary 
earliness, and low-speed playback of accommodative **/gear change with this 
operation gestalt. 



[0020] When accommodative ** / gear change control is chosen within a 
low-speed playback period by stages (207), therefore, as for a display module 
105, accommodative ** / gear change is performed for performing the following 
display control in a low-speed display phase (208). T'(n) =Torig(n) *mDiff(n) 
*beta - it is - T' - if it is (n) <Tmin - T - accommodative **/gear change are 
performed within a low-speed playback period by making the period of a frame 
change with the algorithm of (n) =Tmin. the period of the frame with which, as for 
T (n), the n-th frame was changed here - it is - Torig - the period of the frame 
at the time of normal playback it is - the case of (NTSC - 1 / 30-second), and 
mDiff (n) - the magnitude of a difference image with the contiguity frame in the 
n-th frame, and Tmin - an equipment - it is the period of the minimum anaclitic 
frame and beta is a rate accommodation multiplier which determines extent of 
automatic rate accommodation. Since Torig (n), Tmin, and a beta value are 
decided beforehand, if the period (T (n)) of a frame is adjusted If the magnitude 
(mDiff (n)) of a difference image is large, the period (T (n)) of a frame will 
become large. It is relatively displayed more slowly within a low-speed period, 
and if the magnitude (mDiff (n)) of a difference image is small, the period (T (n)) 
of a frame becomes small and is displayed relative more quickly within a 



low-speed period. 

[0021] The period of a frame can make automatic regulation extent of a rate 
change with the magnitude of a difference image, when a low-speed playback 
algorithm specifies the rate accommodation multiplier beta appropriately. Thus, it 
is performed until accommodative display rate automatic regulation within a gear 
change period has a deactivate request by stages (209), and if there is a 
deactivate request, it will return to the phase (201) of stopping a gear change 
display by stages (210), and reading a moving picture file. 
[0022] 

[Effect of the Invention] As explained in full detail above, when it displays a 
moving picture quickly or slowly according to the accommodative rate automatic 
regulation equipment of the moving picture of this invention, and its approach, 
human being's vision and sensuous property are considered and gear change 
extent within ** / gear change period can be regulated automatically. For 
example, in high-speed retrieval, through [ quicker ] and quicker intense Tokoro 
of change of a scene can search for the place which does not almost have 
change of a scene by the motion carried out more slowly. For example, in 
low-speed retrieval, through and the place where a motion of a moving picture is 



intense where the place which does not almost have a motion of a moving 
picture is quicker are advanced more slowly, and can be searched to a precision. 
Thus, the image which will seldom move like a concert by attaining precise 
retrieval also with an image with many motions like a sport relay broadcast within 
a gear change period if displayed relatively quickly or slowly from the gear 
change rate can be searched at a high speed. In addition, by performing 
alternatively high-speed playback of the existing ordinary earliness and 
low-speed playback, or accommodative accommodative ** / gear change control 
phase of this invention, the gear change playback suitable for a user's retrieval 
purpose is attained, and this invention can determine extent of the gear change 
by setup of an automatic rate accommodation multiplier. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram having shown the automatic rate adjustment 
of the moving picture of this invention. 

[Drawing 2] It is the flow chart having shown the automatic rate accommodation 
approach of the moving picture of this invention. 
[Description of Notations] 

101: Moving picture file 102: Detection module of rate accommodation 
information 

103 104: Storage module 105: Display module 
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o TiSaiWIBrt ± t) 51 < xV 77 W £ ft3 

[ii*9i 3] i?$)\<?-5mm^®i.frt>mm 
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MIBlBlit S ft fcg KflkO A * $ * S*»c 7 U- A <DJS ffi 
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